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the  method  of  estimation  presently  employed  are  compared  with 
standard  maximum  likelihood  procedures.  By  simulating  several 
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1.   INTRODUCTION  AND  SUMMARY 

In  a  previous  report  [1],  the  use  of  MAD  (mean  absolute  deviation) 
in  the  analysis  of  demand  variability  as  proposed  by  R.  6.  Brown  [3] 
and  presently  used  by  NavSup  [4]  was  discussed.   In  particular,  the  use 
of  exponentially  smoothed  estimates  of  MAD  was  criticized  on  theoretical 
grounds  and  a  case  was  made  for  further  study  into  the  probability 
distributions  of  the  various  estimators  presently  in  use.  Of  special 
importance,  the  use  of  MAD  in  setting  safety  levels  was  mentioned  as  a 
problem  area  in  need  of  further  investigation. 

The  present  report  concerns  itself  with  the  extension  of  research 
investigations  in  the  areas  just  mentioned.   Several  attempts  to  derive 
the  necessary  probability  distribution  theory  for  MAD  estimators 
resulted  in  disappointing  futility  for  the  most  part.  This  was 
anticipated  for,  as  previously  mentioned  in  [1],  absolute  deviation  as 
a  measure  of  variability  has  been  abandoned  for  years  on  theoretical 
grounds  by  Statisticians. 

Two  minor  results  that  were  obtained  concern  the  ratio  of  MAD,  A, 
to  standard  deviation,  a.  The  complete  result  of  this  ratio  has  been 
determined  for  the  Poisson  case.  As  alluded  to  in  [l],  the  universal 
use  of  ft     *  0.8  for  this  ratio  is  especially  bad  for  low  demand 
Poisson  item.  The  same  general  criticism  can  be  made  in  the  negative 
binomial  case.  However,  it  was  found  that  for  the  choice  of  parameters 
presently  being  used  by  NavSup,  the  approximation  of  this  ratio  by 
0.8,  is  a  good  one. 


Failing  to  obtain  the  required  distribution  theory  to  study  the 
behavior  of  MAD  estimates „  simulation  was  used  to  compare  smoothed 
estimates  of  o     to  the  usual  maximum  likelihood  estimates  mostly  for 
the  case  of  normal  demand.  Parameter  choices  that  reflect  high  demand 
items  were  selected  in  order  to  give  MAD  the  best  possible  advantage  in 
the  comparison  with  alternate  methods  of  estimation.  Such  parameter 
choices  were  made  after  consultation  with  NavSup  personnel  in  order  to 
duplicate  situations  that  actually  exist;  moreover j>  large  amounts  of  real 
data  are  available  for  such  cases.  In  every  single  case  studied s  the 
sample  variance  of  the  smoothed  estimate  of  MAD  and  consequent  estimate 
of  cr  was  roughly  twice  that  of  the  maximum  likelihood  estimates  of  a. 
The  same  was  true  in  a  slow  mover  case  or  two  that  was  examined.  This 
confirms  in  a  general  way  the  observation  made  in  a  similar  study  carried 
out  by  Asher  and  Wallace  [2]  in  which  they  found  MAD  to  be  significantly 
less  efficient  (about  2©XS>  compared  to  the  classical  minimum  variance 
estimators  under  the  Gauss "Markov  assumptions. 

Mot  content  merely  to  confirm  this  observation  however^  the  estimates 
found  were  used  further  to  see  what  the  actual  effects  on  reorder  levels 
were.  This  was  approached  in  several  ways.  First „  MAD  and  maximum 
likelihood  were  compared  by  computing  the  percentage  of  time  the  known 
theoretical  reorder  level  was  overestimated s   thereby  resulting  in  too 
much  on  hand  stock.  Secondly^  the  results  were  examined  to  see  what 
percentage  of  the  observations  fell  within  k  unit®  of  the  theoretical 
order  level  for  k  s  1,2»***  and  various  fixed  values  of  risk.  Finally, 
the  two  methods  were  compared  by  setting  reorder  levels  and  then  computing 


the  actual  risk  attained  by  those  levels  wherey  tax   each  case  again8  the 
theoretical  or  true  risk  is  known,,  As  seen  in  Section  4»  exponentially 
smoothed  mean  and  MAD  cam®  off  second  best  compared  with  maximum  likeli- 
hood estimates  of  u-  and  o     in  every  single  case  examined. 

Recognizing  the  limitations  of  simulation ,  no  sweeping  claim  is  here 
made  for  proof  that  exponent ially  smoothed  MAD  is  an  inefficient  method 
of  accounting  for  demand  variability.  At  the  same  time*,  one  cannot  ignore 
the  fact  that  present  methods  were  uniformly  inferior  in  the  situations 
examined „ 

In  Section  5  recommendations  for  farther  study  are  made.  Among  these 
is  the  suggestion  that  real  data  be  used  from  the  histories  available  at 
FMSO  for  comparing  the  results  in  retrospect  with  what  would  have  been  the 
case  had  maximum  likelihood  procedures  been  usedo  The  writer  wishes  to 
thank  Lt«  Ozden  Orneck  for  his  invaluable  assistance  in  constructing  and 
running  the  computer  programs  as  well  as  assistance  in  mathematical 
derivations..  Acknowledgement  should  also  be  given  to  Cdr.  Jack  E.  White  of 
FMSO  for  his  unfailing  cooperation  in  defining  the  problem  areas  and  supply* 
ing  parameter  values  that  are  realistic  in  terms  of  NavSup  use.  Credit 
should  also  be  given  to  Mr,  James  W»  Priehard  (SUP  04E)  for  his 
continued  endorsement  and  interest  in  this  research  area. 

2°  RATIO  OF  A  TO  a 

It  will  be  helpful  to  review  some  parametric  definitions  and 
establish  a  notation  to  be  used  here  and  in  ensuing  sections.  Let  X 
be  a  random  variable  with  mean  M.  and  variance  a2  (standard  deviation 

o")  .  The  mean  absolute  deviation;,  MAD  for  short 9  will  be  denoted  A 


and  is  defined  as 

(2.1)  A  -  KC|X^|) 

As  remarked  in  [l3„  it  would  be  more  rational  to  define  M&D   as  E(|x-m|) 
where  in  is  the  median  of  X  but  it  is  (2.1)  that  is  used  by  Brown  [.3] 

and  NavSup  [4].  Consequently  the  same  definition  is  adopted  in  this 
report. 

Now  when  X  is  normally  distributed g   it  is  well  known  that  the 
ratio  of  A  to  a  is  given  by  /%    crp  roughly  0.8.  It  is  somewhat 
surprising  that  the  rati®  is  approximately  the  same  for  certain  other 

families  of  probability  distributions  such  as  the  Exponent ialj,  Uniform 

and  Triangular.  However s   this  result  is  not  universally  true  and  is 

particularly  a  poor  approximation  for  the  P®iss©n  family »  a  model  often 

used  for  the  so°called  slow  mover  type  of  inventory  item.  This  fact 

was  demonstrated  earlier  in  [l]  by  examining  the  rati©  for  selected 

values  of  the  Poiss®n  parameter s   X.  That  ratio  has  now  been  determined 

for  all  values  of  X  and  it  may  be  instructive  to  see  the  behavior  of 

this  ratio  in  a  complete  sense. 

By  L%]»   we  shall  mean  the  greatest  integer  in  zs   that  is,  the 

largest  integer  n  such  that  n  &  %     (and  hence  2  <  n  +  1)  .  We 

denote  the  Poisson  (X)  mass  function  by  p  so  thatj, 

x 
p<x)     -     e~Xl0    ,       x  -  ©8ljg/0' 

Then  we  have9  recalling  that     |i  s  o^  a  X     for  this  case0 


A  =  E(|x=n|}>  -  V|x-X|p(x)  -  ^  (X-x)p(x)  +   ^   (x-X)p(x) 

x*0  ^S[X]+1 


z 
Butj,  letting  F(z)  a  L  p(x)  define  the  Poisson  distribution  function9 


Cx]  [X]  • 

V    (X-x)p(x)   -  \F([X]>  -      )     *P<*)   "  XF([X]  +       )       xp(x)    -   X 

y  (x-x)p(x>  =  y  xp(x>  -  x + x  p([x]) 

x-[X]+l  x»[X]+l 

Adding  these  results,  m 

(2.2)  A  -  2  X  F([X])    -  2  X  +  2      X      XP<X>    • 

x*[XJ+l 

But,   for  x  i  1, 

-X  \X  _^  »x-l 

xp(x)  =  xe      A   -  Xe       ft     R  ■   -  Xp(x-l)    . 

x»  (x-i): 

Hence, 

•  •  • 

y  xp(x)  -  x  y  p(x-i)  =  x  y  P(y>  =  x(i-F<cx]-i))o 

x-CXl+l  x=[X]+l  y=Tx] 

Substituting  this  result  in  (2.2) , 

A  =  2  X  F([X])   -2X  +  2X-2X  F([X]-1) 

-  2  X(f[X]-F([X]-1)) 

-  2  X  p| 
Thusj, 

(2.3)  A  -  2  Xe"A  *  for  amy     X  >  0. 


Since    <x  ■  /X    we  have,, 

(2.4)  £  -  2  A  e       X 

Cx]» 

A 

The  graph  of    ~~     as  a  function  of     X     appears  in  Figure  1. 


Figure  1.  Graph  of  — 

The  analysis  that  validates  the  graph  is  the  following. 

If  n  <  X  <  n  +  1  then  [X]  -  n  and,  £  =  ■§«  X    e  . 

As  a  function,  say  f  ,  of  X  in  this  open  interval,  f   is 

n  n 

differentiable  with, 

f'(X)  -£,  e"X  Xn"%  (n+fc-X) 
n     n« 

Hence,     f '(X)  >0     if     X<n  +  %     and     f '(X)  <0     if     X>n  +  % 
n  n 

so  that  f   possesses  a  relative  maximum  at  X  ■  n  +  %  with  a 

maximum  value  of  f  (n+%)  $   for  n  ■  0,1,2,  *"• 

With  the  formulas  established  for  f   and  f  .   it  is  easy 

n       n+1 
A 
to  verify  that  ~  is  continuous  at  each  of  the  integers  although 


not  differentiable  there.  In  any  case,  it  is  shown  in  the  appendix 

A 

a 


that  the  sequence  of  values  of  ~  at  n, 


2   n+%  -n 

~e  n    • 

n* 


-  6 


is  monotone  increasing.  Using  Stirlings  approximation  [7]  to  n! , 

/2H  nn+1  e"n<n!</innH  •""(l+TT-tf 

I2n-1 

we  see  that, 


/Z  : —  <  f  (n)  <  */2 

l2n=l 


and  11m  f  (n)  ■  %/j2  .  Thus  the  values  of  .=  converge  in  the  limit 

n-*»        _  TT  ° 

to  the  factor  fl   .  However,  as  previously  remarked  in  [l]  and  as 

IT 
seen  visually  in  Figure  1,  approximating  —  by  /2  is  particularly 

a  TT 

bad  when  X  <  1  which  is  precisely  when  the  Poisson  assumption  is 

of  primary  interest. 

For  intermediate  movers s   the  negative  binomial  distribution  is 

employed  as  a  model  for  demand.   Specifically;,  from  [4],  such  an 

assumption  is  made  whenever  mean  demand  is  between  2  and  20  units. 

The  negative  binomial  distribution  is  a  family  of  probability 

•i 
mass  functions  having  two  parameters  r  and  p  where  r  is  a 

positive  integer  and  0  <  p  <  1  .  For  our  purposes  the  general 

formula  for  the  mass  function  is  defined  by, 

P(x)    -   (^"S    pV   »        x  -  0,1,2,' "        (q-l-p) 
The  mean     p.     and  the  variance     a2     of  a  random  variable  having  this 


mass  function  are  given  by, 

Proceeding  as  in  the  Poisson  case,, 

A-E(|xii|)  ■  V  lx"M.|p(x)  -  V(pL-x)p(x)  +    V   (x-tOp(x) 

x^O  x^)  x=»[(l3+l 


But, 

I'^-xx^-SpV 

x«K) 

x=l 

and, 

00 

y  (x-j.x^pV- 

x=l                                   x=0 

Adding  these  results, 

DO  U 

(2.5)    A  =  2[npr  +  pi  Vp(x)  -  ^  xp(x)] 

x*l      x»l 

expressing  A  in  terms  of  finite  sums. 

yrq  A 

Since  o   ■  ~~  9  it  is  no  problem  to  compute  the  ratio  —  for  various 
P  a 

choices  of  r  and  p  on  the  computer. 

It  is  easy  to  choose  values  of  r  and  p  for  which  the  ratio 
is  very  different  from  0.8.  However,  the  interest  would  only  be 
academic  for  values  of  r  and  p  such  that  u-  £  [2,20].  For  that 
range  of  values,  a  total  of  1,000  cases  were  considered  as  follows. 
Let  |ft  €  [2,20]  be  selected  and  for  each  such  p>>  r  was  allowed 

to  vary  over  the  set  {2,4,6, *** ,20}.  For  each  such  choice,  p  is 

r 

then  determined  from  the  relation  p  ■  and  q  is  specified  by 

r-ty, 

-  8  - 


A 


q  ■  1  -  p.  Then  A  was  computed  using  (2.5)   and  finally  —  was 


evaluated.   In  each  such  "group"  of  ten  parameter  pairs,  it  was 
observed  that  —  was  invariably  monotone  increasing  although  there 
was  no  monoticity  from  group  to  group.  More  significantly  however, 
it  was  observed  that  —  varied  always  between  a  minimum  value  of 
0.750  and  a  maximum  value  of  0.805.  For  example,  if  p  =  0.893 
and  r  -  20  whence  p.  =2.4,  we  find  that  ~   =  0.805  although  for 


p  ■  0.455  and  r  =  2,  resulting  also  in  p,  -  2.4,  -  -  0.770.  On 

the  other  hand,  for  p  -  0.174  and  r  =  4,  yielding  p  =  19, 

^  ■  0.781  so  that  low  values  of  ^  are  not  always  associated  with 

low  values  of  ix. 

In  summary,  then,  we  may  say  that  for  the  negative  binomial 

case  and  the  range  of  parameter  values  presently  used  by  NavSup, 

the  approximation  fl     for  —  appears  to  be  a  safe  one. 

T?      CT 

3.   ESTIMATING  VARIABILITY  WITH  MAD 

Having  established  the  value  of  ^  for  cases  of  particular 
interest  in  the  inventory  models,  it  follows  that  O"  ■  k  A  for 
some  constant  k.  Consequently D  if  A  is  estimated  directly  from 
the  data  to  obtain  an  estimate  A  ,  say9  then  o     can  be  estimated 
by  applying  the  formula  a  ■  k  A  .  In  this  way,  one  obtains  a 
measure  of  the  variability  of  demand  through  estimates  of  A  . 
How  good  such  a  procedure  might  be  clearly  depends  upon  the 
technique  used  to  estimate  A  in  the  first  place  and  what  the 
effect  is  on  scaling  that  estimate  by  the  factor  k  to  obtain  9. 


There  are  of  course  many  different  ways  to  estimate  a   . 

Following  Brown  [3]s  NavSup  uses  a  formula  based  upon  exponentially 

smoothing  certain  error  forecasts  defined  as  follows*  Let  Xq^Xi,"**^ 

denote  independent  demands  over  discrete  units  of  time  up  to  and 

including  t.  Suppose  that  X  ,   is  a  forecast  of  the  demand  at 

time  t,  such  forecast  being  made  at  time  t°l.  Then  the  difference 

et  °  Xfc  -  «^t-l  9  represents  a  forecast  error  that  is  dependent  upon 

the  method  of  forecasting  used.  Again  following  Brown-,  suppose  that 

exponential  smoothing  is  used  to  forecast  so  that,  using  smoothing 

constant  a, 

t-2 


<*■!  ■  -I*** *  r\ 


In  this  report  we  will  only  be  considering  the  model  where  random 

2 

demand  X  is  normal  with  constant  mean  p,     and  variance  o   .  With 

this  in  mind  we  have9  as  previously  reported  in  [l]9 

E  (et)  -  0   for  all  t 
and  the  error  terms  have  t  interdependent  variances  given  by^ 

However,  if  we  let  t  -»  °°  ,  we  obtain  a  limiting  variance  of 

Now  for  each  ts  et,  being  a  linear  combination  of  independent 
normal  random  variables ,  is  again  normal  and  its  mean  absolute 
deviation9  L&i     is  related  to  ag  by  ag  ■  *-   Afi  as  previously 

-  10  - 


established.     Consequently.,    from  (3.1)   we  may  write,   asymptotically, 


(3.2)  a  =  ,/^f        „e  . 

This  formula  relates  demand  variability  to  the  mean  absolute 
deviation  of  error  forecasts. 

The  formula  used  in  [3]  and  [4]  to  estimate  A   and  ultimately 
o     is  based  on  an  exponentially  smoothed  function  of  the  error 
forecasts.  If 


t-1 

-kl 


=  «I>k. 


k=0 
then     a     is  estimated  for  demands     Xjp#**,Xt9     by 

(3.3)  a  -  <Ef2L  Afc 

As  remarked  in  [l],  the  worth  of  this  estimation  procedure  is 
difficult  to  assess  without  some  knowledge  of  the  probability 
distribtuion  of  A  .  Serious  efforts  notwithstanding,  that 
probability  distribution  has  not  been  derived  to  date.  The  real 
basic  difficulty  is  that  random  variables  e^e.j  •  •  •  ,efc  which 
compose  At  ,  while  normally  distributed,  are  not  mutually 
independent.  Even  the  matter  of  finding  the  second  moment  of  A. 
has  been  intractible  thus  far. 

In  an  effort  to  discover  some  indication  of  the  variability 
involved,  a  simulation  study  was  undertaken  and  resulted  in  mounting 
evidence  that  there  is  reason  to  believe  that  the  variance  of  A 
is  bounded  below  by  a  positive  quantity  so  that  even  in  the  limit 

=  11  = 


the  actual  estimates  a  based  on  this  quantity  will  fluctuate 
about  the  true  value  (J, 

In  turn,  this  immediately  suggests  comparing  this  method  of 
estimation  with  the  classical  maximum  likelihood  estimate  a 
given  by  the  formula, 

(3.4) 

Now,  properties  of  a  are  well  known  (see  [5]  for  example) ,  being 
derived  from  the  so-called  Chi-distribution.  In  fact. 


.      r-r  PL  iS 

Zip)   a/l-^  (Xt<J    where     <*t  ■,/t-l     jyt 


and, 

V(a)   -  £j±  0?  a2  ,     where     0?  -  1  -  a2  &       1 

C       fc  «  t       2(t-l) 

From  these  formulas  we  see  that 

1*0,8(5)   -  o 

(3.5) 

lim  V(a)    «  0 

t-»» 

Hence,  if  it  is  true  that  the  variance  of  o*  is  bounded  away  from 
zero,  then,  even  though  unbiased  in  the  limit,  the  fact  that  a  has 
a  vanishing  variance  would  make  it  preferable  as  an  estimating  tool. 
Our  simulation  results  certainly  seem  to  concur  that  this  is  the 
case. 

For  simulation  purposes,  several  members  of  the  normal  family 
were  selected  so  as  to  be  representative  of  a  wide  class  of  fast 

-  12  - 


moving  inventory  items.  Using  random  generation  samples  of  size 
200  were  drawn  from  these  populations  and  a  running  account  was 
kept  of  the  estimates  o     and  Q     of  the  true  and  known  standard 
deviation  a.  This  was  done  by  computing  the  values  of  (3.3)  and 
(3*4)  at  each  time  period  t. 

Incidentally,  it  should  be  observed  in  this  regard D  that  the 
running  computation  of  a     involves  no  more  time  nor  storage  than 

that  of  a,  a  feature  often  cited  as  one  compelling  reason  for 

*2 
using  exponential  smoothing.  It  is  true  that  o      will  have  to  be 

stored  and  updated  at  the  next  time  period  and  hence  one  extra 

operation ,  that  of  taking  the  square  root8  will  be  involved.  But 

with  modern  computers 9   the  time  for  this  extra  operation  is 

negligible. 

The  actual  point  by  point  results  of  the  simulation  are  perhaps 
not  too  enlightening.  The  program  that  was  used  has  been  preserved 
and  is  available  for  further  use*  Of  more  interest  is  a  comparison 
of  the  two  procedures  with  regard  to  bias  and  variance .  These 
have  been  estimated  by  computing  the  sample  average  and  sample 
standard  deviation  (S.D.)  of  each  of  a  and  o"  for  each  parameter 
choice.  While  many  more  cases  were  examined 8  the  results  for 
parameter  choices  furnished  by  NavSup  are  summarized  in  Table  1. 
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Parameter 
Pairs 

Average 
a 

Average 
a 

r— ~ 

Bias 

as 

a 

1 
Bias 

A 

a 

S.D. 
a 

S.D. 
a 

NobiEo      M«S*E* 

a              a 

(50,10) 

10.27 

9.60 

0.27 

=0.40 

2.83 

1.33 

8.08 

1.93 

(100,25) 

25.67 

23.99 

0.67 

-1.01 

7.08 

3.31 

50.57 

11.98 

(100,50) 

51.33 

47.98 

1.33 

-2.02 

14.15 

6o  63 

201.99 

48.04 

(400,40) 

41.07 

38.39 

1.07 

-1.61 

lil.32 

5.30 

129.29 

30.78 

(500,50) 

51.38 

48.52 

1.38 

-1.48 

14.15 

7.40 

202.13 

56.95 

(600,60) 

61.60 

57.58 

1.60 

-2.42 

16.98 

7.95 

290.88 

69.06 

(700,70) 

64.99 

58.78 

-5.01 

-11.22 

21.40 

10.56 

483.06 

237.40 

(800,80) 

81.51 

76. 15 

1.51 

=3.85 

19.18 

5.85 

370.15 

49.04 

(900,90) 

87.26 

86.21 

=2.74 

-3.79 

21.09 

5.01 

452.30 

39.46 

(1,000,100) 

101.89 

95.18 

1.89 

-4.82 

23.97 

7.32 

578.13 

76.81 

Table  1.  Sample.  Characteristics 


The  table  clearly  brings  out  the  inefficiency  of  the  smoothing 
technique  compared  with  classical  methods  of  estimation.  Both  proce- 
dures are  biased.  The  smoothing  procedure  tends  to  overestimate  while 
the  maximum  likelihood  procedure  more  conservatively  underestimates 
O",  a  fact  known  from  the  theory  of  course.  Except  for  the  one 
extreme  case  (the  pair  (700870)  where  the  bias  for  o*  is  numerically 
as  large  as  11  for  some  reason  that  is  not  consistent  with  the 
other  results,  the  bias  in  both  cases  is  of  the  same  magnitude.  There 
is  a  marked  difference  in  the  variance  estimate  of  the  two  procedures, 
however.  The  variance  for  a  is  significantly  higher  than  that  for 
a  in  every  case.  Indeed,  there  was  never  a  single  normal  case 
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studied  in  which  this  was  not  the  case. 

Since  the  bias  is  roughly  the  same  for  each  procedure  this  means 
that  the  mean  squared  error  (M.S.E.)  of  each  procedure  will  largely 
be  determined  by  its  variances.  Recalling  that  M.S.E.  is  given  by 
the  variance  plus  the  square  of  the  bias  we  use  the  averages  and 
standard  deviations  of  Table  1  to  compute  estimates  of  M.S.E.  which 
are  recorded  in  the  last  two  columns.  Again  the  difference  in  the 
two  procedures  are  quite  striking.  The  M.S.E.  for  a  reaches  as 

high  as  12  times  that  for  a  in  one  case  and  even  in  the  pathological 

a 
case  cited  above  (the  pair  (700,70))  where  the  bias  of  a     is 

o»  A 

unexplainably  high,  the  M.S.E.  of  a     is  still  twice  that  of  a. 
In  most  of  the  cases,  the  ratio  is  about  4. 

A  similar  analysis  was  undertaken  for  Poisson  demand  with  results 
that  are  not  quite  as  striking.  These  are  summarized  in  Table  2  for 
three  typical  cases. 


!  Parameter 

a 

Average 
a 

Average 

a 

Bias 
a 

Bias 

A 

a 

S.D. 
a 

S.D. 

A 

a 

M.S  *E. 
a 

M.S • E • 

A 

a 

.01 

0.1 

.01 

.06 

=  .09 

=.04 

.04 

.04 

i 
.0097 

.0032 

0.1 

0.3 

.17 

.23 

-.13 

-.07 

.13 

.06 

.0338 

.0085 

1.0 

1.0 

.91 

.95 

=  .09 

-.05 

.28 

.12 

i i 

.0865 

.0169 

Table  2.  Poisson  Demand 
Again  it  should  be  observed  that  the  M.S.E.  for  a  is  at  least  3 

A 

times  that  for  a  in  each  instance  examined. 
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4.   EFFECTS  ON  REORDER  LEVELS 

Not  satisfied  to  merely  summarize  the  evidence  obtained  as  in 
the  tables  of  the  preceding  section,  it  was  deemed  advisable  to  test 
the  effects  of  the  forecasting  errors  on  their  use  in  fixing  reorder 
levels.  Again  for  reporting  purposes,  the  main  concentration  was  spent 
on  the  normal  case.   If  demand  is  normal  with  mean  p.  and  standard 
deviation  a,  then  the  (theoretical)  reorder  level  would  be  set  at 
\U   +  ka  where  k  is  chosen  to  satisfy  a  given  risk  p  defined  by 

p  ■  P(X  >  p.  +  ka) 
Thus,  the  risk,  for  present  purposes,  is  the  probability  that  demand 
will  exceed  the  reorder  level  causing  a  stockout.  For  given  p  (or  k) 
the  parameter  k  (or  p)  can  be  determined  from  standard  normal  tables. 

Of  course  u>  and  o     are  unknown  so  that   p  can  never  be 
satisfied  exactly.   If  we  were  to  use  M>   aud  a   for  the  reorder 
level  and  it  should  happen  that  [i  +  ka  >  p.  +  ka  where  k  has 
been  chosen  to  satisfy  a  given  risk  requirement  p,  then  the  true 
risk  say  p  =  P(X  >  u,  +ko)  would  be  something  smaller.  This 
means  that  simultaneously  overestimating  u-  and  a  results  in  over- 
stocking, that  is,  we  could  stock  less  to  achieve  the  required  risk 
level.  There  may  also  be  penalty  costs  in  the  way  of  storage,  costs 
to  consider  for  such  a  situation.   On  the  other  hand-  if  p.  +  ka  < 
M-  +  ka  then,  while  we  think  we  are  stocking  in  such  a  way  as  to 
achieve  a  given  risk  p,  in  fact  the  true  risk  p   would  be  greater. 
The  resulting  shortage  "cost"  paid  for  such  a  position  could  be 
disastrous.   Since  neither  position  is  particularly  favorable,  and 
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the  true  parameter  values  are  unknown^  it  is  clear  that  the  most 
precise  estimates  of  \i     and  a  are  desirable;  precise  in  the  sense 
of  minimum  fluctuation  about  the  true  values. 

Trying  to  determine  the  true  risk  incurred  when  exponentially 
smoothed  estimates  M>  and  a  of  p.  and  o „   respectively ,  are  used 

ma 

theoretically  requires  the  joint  probability  distribution  of  X,  H 
a.  If  finding  the  distribution  of  a  alone  seems  difficult,  the 
task  of  finding  such  a  joint  distribution  looms  formidable  to  say  the 
least o  Fortunately ,  in  a  simulation  approach  the  parameters ,  and 
hence  the  true  theoretical  reorder  level  for  a  given  risk  p»  is 
known.  For  any  procedure  used  to  set  actual  reorder  levels  it  is  then 
possible  to  observe  the  behavior  of  repeated  applications  of  such  a 
procedure.  There  are  many  ways  this  might  be  done.  One  approach  is 
to  observe  the  number  of  times  a  reorder  level  falls  within  so  many 
units  of  the  theoretical  level.  0r8  for  a  given  percentage  P  we 
might  ask  within  how  many  units  of  the  theoretical  reorder  levels 
will  P  percent  of  the  actual  reorder  levels  be  found?  We  have 
done  a  little  of  both  and  summarised  the  findings  for  various  cases 
in  Table  3. 

The  table  is  constructed  as  follows.  First  a  triple  of  parameters 
(M>£>  a»  P)  is  chosen  where  p  is  the  desired  risk.  From  this  k  is 
determined  from  tables  and  a  theoretical  reorder  level  computed.  For 
example8  if  u  -  400 ,  Q   s  40  and  p  s  .01  then  from  .01  -  P(X>400+40k) 
we  determine  k  3  2.326  and  theoretical  reorder  level  is  493.04.  Then, 
for  each  parameter  triple  Q^  is  the  percentage  (rounded)  of  200 
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reorder  levels  found  to  be  within  1  unit  of  the  theoretical  reorder 
level  first  for  the  level  based  on  exponential  smoothing  \i>  +  ko 

and8  second^  for  a  level  set  using  X  +  ko~  where  O"  is  the  maximum 
likelihood  estimate  of  o     and  X  is  the  average  demand <>  Next8  P-q 
represents  the  number  of  units  about  the  theoretical  reorder  level 
within  which  50%  ©f  the  computed  reorder  levels  were  found „  Again., 
the  first  column  under  Pen  is  for  smoothed  estimates  and  the  second 
for  maximum  likelihood  estimates.  The  last  column  is  a  similar 
computation  for  95%  of  the  reorder  levels. 


Parameter 

Triples 


( 

( 

(100s259o50) 
.840s.01) 


>B.5( 


(600,60  5.50]> 


980s.o: 


(10©0S  100  9.01) 
(1000,100,  .11) 

( 10002 100 ,. 50) 


19 


15 


13 


II 


18 


3 

4 


28 


35 
27 


4 


17 


13 
6 
5 

21 
9 


85 


129 
85 


14 
12 
46 
30 
23 
58 


Table  3.  Percentiles  for  Reorder  Levels 


Many  more  cases  than  those  reported  In  the  table  were  examined 
but  the  results  are  omitted  for  the  sake  of  brevity.  The  results  in 
these  other  cases  displayed  precisely  the  same  pattern  however. 
Indeed,  the  consistency  of  the  various  cases  is  somewhat  startling. 
Once  again  there  is  not  one  single  choice  of  a  mean;,  a  standard 
deviation  or  a  risk  in  which  the  smoothing  procedure  does  not  fall 
significantly  short  of  maximum  likelihood  techniques.  This  was  to 
be  expected  of  course  since  the  variance  of  the  estimators  involved 
determine  the  amount  of  flucutation  from  sample  to  sample. 

One  other  interesting  observation  in  Table  3  is  the  monotonic 
nature  of  P~q  and  Pq-.  Thus&  while  it  always  takes  more  units  of 
distance  (roughly  twice  as  many)  to  include  95%  of  the  values  using 
smoothing  versus  maximum  likelihood ,  the  comparison  at  the  50%  level 
is  even  more  striking.   In  addition  to  requiring  roughly  ten  times  as 
many  units  to  cover  50%  of  the  observations  for  smoothing 9  the 
number  of  units  for  the  same  percentage  using  maximum  likelihood  is 
comfortably  small. 

Another  way  to  view  the  results  is  to  try  and  estimate  the  true 
risk  incurred  when  a  given  procedure  is  followed.  One  way  to  do  this 
is  to  imagine  that3  after  2C0  observations,  the  estimates  say  m> 
and  o*   coincide  with  the  parameters  and  then  compute  POPv-  +k<*  j 
as  a  measure  of  the  true  risk.  With  a  sample  size  of  200 ,  the 
asymptotic  result  of  supposing  that  estimates  and  parameters  are  the 
same  should  be  fairly  sound.   Of  course  the  point  is  that  how  sound 
such  an  estimate  is  depends  upon  the  precision  of  the  estimate  once 
again.   In  any  event  in  practice  this  is  essentially  what  is  done  and 
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200  is  a  figure  quite  a  bit  larger  than  the  typical  number  of  periods 
for  which  historical  data  are  maintained  for  making  such  estimates 
within  NavSup. 

In  Table  4  our  results  are  summarized  as  follows .  Agains  certain 
triples  of  parameters  M-3  Q     and  p  are  selected.  This  time,  for 
each  pair  Ql,  a)  down  a  column;,  five  different  risks  are  associated 
across  a  row.  For  each  such  combination,,  an  actual  reorder  level  is 
determined  in  two  ways.  First  of  all,,  k  is  determined  and  then 
reorder  levels  fixed  at  |A  +  ka  and  X  +  kcr.  After  the  200th 


+j 


observation  p  =  P(X>p.  +ka^ 
(suitably  rounded) ,  first  for 


e@napu 


and  entered  in  each  cell 


v   ,a  )  ■  (V>so)      and  second  for 


(|A  ,a  )  <=  (Xsct)  .  For  lack  of  a  better  name,   p  '  is  called  the  actual 
risk.   In  this  way9  the  actual  risk  incurred  using  smoothing  may  be 
compared  with  maximum  likelihood  procedures. 


(M>^>^ 

0 

01 

0 

05 

a 

11 

• 

25 

. 

50 

(100,25) 

.01 

.01 

.05 

.05 

.13 

,11 

.30 

.25 

.60 

.52 

(400s40) 

cOl 

.01 

.05 

.05 

.13 

,11 

.30 

.  2!5 

.60 

.  52 

(500,50) 

.01 

.01 

.05 

.05 

.13 

.11 

.30 

o  25 

.60 

.52 

(600,60) 

.01 

.01 

.05 

.05 

.13 

,  11 

,30 

.25 

.60 

.52 

(800,80) 

.06 

.01 

o  18 

.05 

.31 

o  A<fc 

.52 

.26 

.76 

.52 

(900,90) 

o    JL(fc 

.02 

.20 

.07 

.27 

o  13 

.37 

o  tiL  8 

.50 

.51 

(1000,100) 

e06 

.01 

.18 

.05 

.31 

.12 

.52 

.26 

.77 

.52 

\o     Actual  Risks 

The  results  are  fairly  self-explanatory.  The  results  are  even  fairly 
consistent  in  the  sense  that  for  most  parameter  choices  the  asymptotic 


results  are  quite  the  same.     For  large  means  and  variances  more 
variation  begins  to  show  up.  We  see  that  for  small  values  of  p,  both 
precedures  are  roughly  equivalent.  That  is  to  say8  after  200 
predictions,  the  actual  risk  is  fairly  close  to  the  true  risk.  But 
for  large  or  even  moderate  values  of  p  it  appears  that  smoothing 
consistently  produces  a  larger  actual  risk  than  maximum  likelihood. 
Both  are  larger  than  the  true  risk  but  the  maximum  likelihood 
procedure  is  much  closer  to  the  true  value  and  is  far  more  consistent. 


Risk 

p.  +  ka 

M-  +  ka 

x  +  ka 

oOl 

51 

38 

44 

,02 

52 

38 

43 

.03 

52 

40 

41 

.04 

53 

39 

40 

.05 

54 

39 

39 

.06 

52 

38 

37 

.07 

52 

40 

37 

.08 

52 

40 

34 

.09 

52 

40 

35 

,10 

51 

41 

34 

Table  5.   Percentage  Overestimates 
Finally ,  supposing  that  it  is  far  more  serious  to  overestimate 
the  reorder  level  (resulting  in  excess  stock  for  a  given  risk)  than 
to  underestimate  it0  the  data  were  analyzed  to  see  the  percentage  of 
time  the  reorder  level  was  overestimated  in  200  trials.  For  this 
illustration  only  one  distribution  vas  used;  namely.,  normal  with 


21 


mean  50  and  standard  deviation  10.  Agains  for  various  risks 
(this  time  no  more  than  10%)  reorder  levels  are  set  using  U  +  ka 
and  x  +  ka.   This  time  we  examined  a  third  alternatives  a  mixture 
of  the  two  procedures  s  given  by  |A  +  ka„  The  results  are  summarized 
in  Table  5  and  the  entries  are  the  percentage  of  times  that  the  given 
method  overestimates  the  theoretical  reorder  level. 

It  is  by  this  time  perhaps  not  surprising  to  note  that  smoothing 
consistently  overestimates  the  reorder  level.  Even  the  mixed  procedure, 
whereby  smoothing  is  used  to  estimate  the  mean  and  o*  is  estimated  by 
maximum  likelihoods,  is  an  improvement  over  a  MAD  estimate  of  oa 
Compared  with  straight  maximum  likelihoods,  it  is  better  for  small 
values  of  p  and  then  begins  to  fall  off  as  p  increases. 

5.  CONCLUSIONS  AND  RECOMMENDATIONS 

In  drawing  conclusions  it  would  be  well  to  reiterate  the  tentative 
nature  of  simulation  results.  Without  the  exact  probability  distri- 
bution for  the  exponentially  smoothed  estimators  treated  in  this 
report—particularly  MADa-'no  definite  statement  can  be  made  about  the 
efficiency  of  this  method  over  others.  But  the  simulation  results 
display  a  certain  consistency  that  certainly  lends  support  to  the 
claim  that  maximum  likelihood  methods  would  be  superior  for  those 
purposes  to  which  smoothing  is  presently  employed.  Certainly  the 
evidence  is  sufficient  t©  warrant  further  examination  and  comparison 
with  alternatives.  In  spite  of  the  difficulties  involved  in  the 
derivation  of  the  probability  distributions  when  exponential  smoothing 
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is  employed  as  a  forecasting  tool9  it  is  our  recommendation  to  continue 
the  theoretical  search  for  those  distributions  or  at  least  the  moments 
that  are  involved.   In  particular  it  would  be  helpful  to  establish 

Ma 

that  the  variance  of  a  is  bounded  below  by  a  positive  quantity  as 
seems  to  be  indicated  by  the  simulations..   If  this  were  true  then  the 
estimate  will  always  fluctuate  about  the  true  o     regardless  of  how 
many  time  periods  are  considered. 

Another  reason  for  continuing  research  in  this  area  Is  the  fact 
that  even  the  simulation  studies  were  only  carried  out  for  the  normal 
case  (and  the  isolated  Poisson  cases)  with  constant  mean  and  variance. 
This  is  a  strong  assumption  and  entails  supposing  that  no  trend  is 
present.   It  is  highly  recommended  that  a  similar  analysis  in  the 
presence  of  trend  be  carried  out.  The  trend  test  and  indicator 
presently  used  by  NavSup  as  outlined  in  C4]  again  employs  exponential 
smoothing  as  a  basic  tool  for  analyzing  the  data.   If  the  lack  of 
efficiency  indicated  in  this  stody  carries  over  to  that  case  as  well 
then  the  consequences  should  be  even  more  serious.   Indeed ,  there  is 
reason  to  believe  that  with  the  methods  presently  employed,  there 
can  be  a  50%  chance  of  rejecting  an  almost  vertical  trends  that  is 
a  sudden  jump  in  the  demand  pattern.  These  matters  are  certainly 
topical  candidates  for  further  research. 

In  any  or  all  of  the  above  recommendations s   it  is  suggested  that 
real  data  be  used  to  analyze^  unfortunately  perhaps  in  retrospect, 
the  reorder  system  had  methods  such  as  maximum  likelihood  been  used. 
Large  amounts  of  such  data  are  available  for  a  wide  variety  of 
inventory  items  and  the  programs  for  processing  si'.h  data  have  been 
preserved. 
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60   APPENDIX 

This  appendix  is  devoted  to  supplying  the  mathematical  details 
for  the  monotonic  nature  of  M     as  asserted  in  Section  3.   It  should 
be  recalled  from  that  section  that  ^  ,  expressed  as  a  function  of 
the  Poisson  parameter  X  is  given  by 


a  [X]! 

In  particular ,  when  X  ■  n  ,  —  has  a  relative  minimum  with  a  value 

O" 

un  given  by9 


n 

u 

■ 

2 

/n 

e 

n_ 

n 

n» 

It  is  conjectured  that  this  sequence  of  values  is  monotone  increasing. 
To  see  this  observe  that 


u       /■  n+% 

and 

log  JL  -  (n+%)   log  ^Jr  +  1  -  -(n+fc)    l©g(l+jj>   +  1  • 
un+l 

Recalling  the  Taylor  expansion  of     log  (1+x)      (see  [6]   for  examp 

we  have9    for     a  >  19 


L         1  1  1 

log  (1-H^   -  -  -  wmmml  +  -^  °  * 


where  ^  ^ 


1*1  *-^ 


4n4 
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Then, 


log  J!2_  --[l+_i-_i--i_+_!_  +  _I_+  ZStk  R]  +  1 
un+l  2n       2n       4n2       3q2       6n3  2 


=  -  1  .  _JL  -  2n+l 

l2n2   6n3     2 
But  R  <  0  for  this  case  so  that 


2n+2    2n+2  .  ,   _JL_    1 
2  4n3   8n4 


Hence s 


w  Un  <     1     1     1     1  _   (2n2-2n-: 


n+l     I2n    6n    4n    8n        24a  ' 
Now  for  x  -t  2P   the  polynomial  2x2  -  2x  -  3  is  positive  so  that 


u  u 

log   a  <  0  arad  hence  -—-  < 
un+l  un+l 


In  other  words. 


u  <  u       n  s  2r39'»' 
n    n+l 


which  is  what  was  to  be  verified, 
From  [?]    (page 


e   v      W/2TT  (n+%)  e  <  n2   <  /2TT  (n+%)  e 


Since  f  (n+fc)  =  —7  (n+%)    e       we  have 
n       n. 


r-  ,     ^-   24(n-*%) 

/2  <  f  (ttHO  <  /2  e  Z 


TT     n  TT 


A 


Thus  the  sequence  of  relative  maxima  of  -^     converges  to  v2     supporting 

TT 
the  claim  on  page  7  that  —  then  converges  to  this  limit. 


26 


BIBLIOGRAPHY 

[l]   Zehna,  Peter  W.,  Some  Remarks  on  Exponential  Smoothing, 

Naval  Postgraduate  School,  Technical  Report  No.  72,  December  1966, 
[2]  Ashar,,  V.G.  and  T.D.  Wallace,  "A  Sampling  Study  of  Minimum 

Absolute  Deviation  Estimators,"  Operations  Research,  Vol.  11, 

No.  5,  September=October  1963. 
[3]  Brown,  R.G.,  Smoothing,  Forecasting  and  Prediction  of  Discrete 

Time  Series,  Prentice=Hall9  Inc.,  1963. 
[4]  PAR  1  -  Application  D,  Operations  5,  6,  Levels  Computation  for 

Consumables  and  Repairables,  FMSO,  Mechanicsburg,  Pennsylvania, 

1964. 
[5]  Held,  A.,  Statistical  Theory  with  Engineering  Applications, 

John  Wiley  &  Sons,  1952. 
[6]  Taylor,  Angus  E. ,  Advanced  Calculus,  Ginn  and  Company,  1955. 
[7]  Feller,  William,  An  Introduction  to  Probability  Theory  and  its 

Applications,  Vol.  1,  John  Wiley  &  Sons,  1950. 


INITIAL  DISTRIBUTION  LIST 

No.    of  Copies 

Defense  Documentation  Center  (DDC)  20 

Cameron  Station 

Alexandria,  Virginia   22314 

Attn:   IRS 

Library  2 

Naval  Postgraduate  School 
Monterey j  California   93940 

Captain  Thomas  J.  Ingram,  III,  SC9  USN  5 

Director,  Research  and  Development  Division 

(Code  SUP  063) 

Naval  Supply  Systems  Command 

Department  of  the  Navy 

Washington,  D.  C.   20360 

Mr.  James  W.  Prichard  2 

(Code  SUP  04E) 

Naval  Supply  Systems  Command 

Department  of  the  Navy 

Washington,  D.  C.   20360 

Commander  Jack  A.  White ,  SC,  USN  5 

Fleet  Material  Support  Office 

(Code  97) 

Naval  Supply  Depot 

Meehanicsburg8  Pennsylvania   17055 

Professor  Peter  W.  Zehna  25 

Department  of  Operations  Analysis 

(Code  55Ze) 

Naval  Postgraduate  School 

Monterey »  California   93940 

Professor  David  A.  Schrady  1 

Department  of  Operations  Analysis 

(Code  55So) 

Naval  Postgraduate  School 

Monterey,  California   93940 


Professor  Jack  R.  Borsting 
Department  of  Operations  Analysis 
(Code  55) 

Naval  Postgraduate  School 
Monterey,  California   93940 


Commander  R.  E.  DeW inter,  SCr  USN 
Naval  Aviation  Supply  Office 
700  Robbin  Avenue 
Philadelphia „  Pennsylvania 

Professor  K.  T»  Wallenius 
Department  of  Mathematics 
Clemson  University 
Clemson,,  South  Carolina   29631 

Lieutenant  W.  E.  Daeschners  SCS  USN 

PERS  A lib 

Bureau  of  Naval  Personnel 

Arlington  Annex 

Washington  D.  C.    20360 

Dean  C.  E.  Menneken 

Dean  of  Research  Administration 

(Code  023) 

Naval  Postgraduate  School 

Monterey 0   California   93940 


UNCLASSIFIED 


Security  Classification 


DOCUMENT  CONTROL  DATA  -R&D 

iSecurity   .  /«s  vi  lie  at  ion  ot  llllo,    body  <il  nbstriii  I  nnd  mdrxnii  annotation  nmsl  br  entered  when   the  overall  report  Is   r  lasnlliedi 


OHiGinating    activity   (Corporate  author ) 

Naval  Postgraduate  School 
Monterey,  California 


/a.    I.l    PORT    SECURITY    CLASSIFICATION 

UNCLASSIFIED 


/I,      i.urjnl- 


i      RE  POR  T     TITLE 


"FORECASTING   ERRORS   USING  MAD" 


4     DESCRIPTIVE   NOTES  (Type  ot  report  and,  inclusive  dates) 

Research  Report 


5     au  THORiSI  (First  name,   middle   initial,   last  name) 


Peter  W.  Zehna 


6   RE  POR  T  D A  TE 


April  1969 


7a.     TOTAL    NO.    OT    PACES 

33 


76.    NO.    OF    RE  FS 

7 


ta      CONTRACT    OR    GRANT    NO 


9a.    ORIGINATOR'S    REPORT    NUMBER(S) 


NAVSUP  RDT&E  No.   TF015-02-101 

b.    PROJEC  T    NO 


NPS   55Ze904lA 


»b.    OTHER   REPORT   NO(S)  (Any  other  numbers   that  may  be  assigned 
this  report) 


10      DISTRIBUTION    STATEMENT 


Distribution  of  this  document  is  unlimited, 


II       SUPPLEMENTARY    NOTES 


12      SPONSORING    Ml  LI  T  AR  Y    ACTIVITY 


Research  and  Development  Division 
Naval  Supply  Systems  Command 


13   ABSTRACT 


A  study  of  the  effects  of  using  mean  absolute  deviation  (MAD) 
to  estimate  variability  in  setting  reorder  levels  for  the  inventory 
of  a  stock  item.   The  method  presently  employed  by  NavSup  in  setting 
such  reorder  levels  involves  exponentially  smoothed  estimates  of  the 
mean  and  variance  of  the  demand  process.   Any  error  involved  in  setting 
reorder  levels  results  in  a  change  in  the  underlying  risk  which  in  turn 
can  be  translated  into  costs.   Such  errors  for  the  method  of  estimation 
presently  employed  are  compared  with  standard  maximum  likelihood 
procedures.   By  simulating  several  normal  systems,  the  smoothing 
technique  is  found  to  be  inferior  to  classical  methods  with  no  reduction 
in  computational  difficulties. 


DD  ,F„r..1473 

S/N  0101 -807-681 1 


(PAGE  t) 


UNCLASSIFIED 


Security  Classification 


A- 3 1408 


UNCLASSIFIED 


Sei  untv  Classification 


K  F.  V     WOHOS 


INVENTORY  THEORY 

EXPONENTIAL   SMOOTHING 

FORECASTING 

MEAN  ABSOLUTE  DEVIATION 

REORDER  LEVELS 


LINK      A 


LINK     B 


),r.".,1473  'BACK, 


UNCLASSIFIED 


Security  Classification 


